A phase-shifting anterior-posterior network organizes global phase relations.

Prior research has identified a variety of task-dependent networks that form through inter-regional phase-locking of oscillatory activity that are neural correlates of specific behaviors. Despite ample knowledge of task-specific functional networks, general rules governing global phase relations have not been investigated. To discover such general rules, we focused on phase modularity, measured as the degree to which global phase relations in EEG comprised distinct synchronized clusters interacting with one another at large phase lags. Synchronized clusters were detected with a standard community-detection algorithm, and the degree of phase modularity was quantified by the index q. Notably, we found that the mechanism controlling phase modularity is remarkably simple. A network comprising anterior-posterior long-distance connectivity coherently shifted phase relations from low-angles (|Δθ| < π/4) in low-modularity states (bottom 5% in q) to high-angles (|Δθ| > 3π/4) in high-modularity states (top 5% in q), accounting for fluctuations in phase modularity. This anterior-posterior network may play a fundamental functional role as (1) it controls phase modularity across a broad range of frequencies (3-50 Hz examined) in different behavioral conditions (resting with the eyes closed or watching a silent nature video) and (2) neural interactions (measured as power correlations) in beta-to-gamma bands were consistently elevated in high-modularity states. These results may motivate future investigations into the functional roles of phase modularity as well as the anterior-posterior network that controls it.

Visual cortex responds to sound onset and offset during passive listening.

Sounds enhance our ability to detect, localize, and respond to co-occurring visual targets. Research suggests that sounds improve visual processing by resetting the phase of ongoing oscillations in visual cortex. However, it remains unclear what information is relayed from the auditory system to visual areas and if sounds modulate visual activity even in the absence of visual stimuli (e.g., during passive listening). Using intracranial electroencephalography (iEEG) in humans, we examined the sensitivity of visual cortex to three forms of auditory information during a passive listening task: auditory onset responses, auditory offset responses, and rhythmic entrainment to sounds. Because some auditory neurons respond to both sound onsets and offsets, visual timing and duration processing may benefit from each. In addition, if auditory entrainment information is relayed to visual cortex, it could support the processing of complex stimulus dynamics that are aligned between auditory and visual stimuli. Results demonstrate that in visual cortex, amplitude-modulated sounds elicited transient onset and offset responses in multiple areas, but no entrainment to sound modulation frequencies. These findings suggest that activity in visual cortex (as measured with iEEG in response to auditory stimuli) may not be affected by temporally fine-grained auditory stimulus dynamics during passive listening (though it remains possible that this signal may be observable with simultaneous auditory-visual stimuli). Moreover, auditory responses were maximal in low-level visual cortex, potentially implicating a direct pathway for rapid interactions between auditory and visual cortices. This mechanism may facilitate perception by time-locking visual computations to environmental events marked by auditory discontinuities.NEW & NOTEWORTHY Using intracranial electroencephalography (iEEG) in humans during a passive listening task, we demonstrate that sounds modulate activity in visual cortex at both the onset and offset of sounds, which likely supports visual timing and duration processing. However, more complex auditory rate information did not affect visual activity. These findings are based on one of the largest multisensory iEEG studies to date and reveal the type of information transmitted between auditory and visual regions.

Visual speech differentially modulates beta, theta, and high gamma bands in auditory cortex.

Speech perception is a central component of social communication. Although principally an auditory process, accurate speech perception in everyday settings is supported by meaningful information extracted from visual cues. Visual speech modulates activity in cortical areas subserving auditory speech perception including the superior temporal gyrus (STG). However, it is unknown whether visual modulation of auditory processing is a unitary phenomenon or, rather, consists of multiple functionally distinct processes. To explore this question, we examined neural responses to audiovisual speech measured from intracranially implanted electrodes in 21 patients with epilepsy. We found that visual speech modulated auditory processes in the STG in multiple ways, eliciting temporally and spatially distinct patterns of activity that differed across frequency bands. In the theta band, visual speech suppressed the auditory response from before auditory speech onset to after auditory speech onset (-93 to 500 ms) most strongly in the posterior STG. In the beta band, suppression was seen in the anterior STG from -311 to -195 ms before auditory speech onset and in the middle STG from -195 to 235 ms after speech onset. In high gamma, visual speech enhanced the auditory response from -45 to 24 ms only in the posterior STG. We interpret the visual-induced changes prior to speech onset as reflecting crossmodal prediction of speech signals. In contrast, modulations after sound onset may reflect a decrease in sustained feedforward auditory activity. These results are consistent with models that posit multiple distinct mechanisms supporting audiovisual speech perception.

Spatiotemporal dynamics of maximal and minimal EEG spectral power.

Oscillatory neural activities are prevalent in the brain with their phase realignment contributing to the coordination of neural communication. Phase realignments may have especially strong (or weak) impact when neural activities are strongly synchronized (or desynchronized) within the interacting populations. We report that the spatiotemporal dynamics of strong regional synchronization measured as maximal EEG spectral power-referred to as activation-and strong regional desynchronization measured as minimal EEG spectral power-referred to as suppression-are characterized by the spatial segregation of small-scale and large-scale networks. Specifically, small-scale spectral-power activations and suppressions involving only 2-7% (1-4 of 60) of EEG scalp sites were prolonged (relative to stochastic dynamics) and consistently co-localized in a frequency specific manner. For example, the small-scale networks for θ, α, ß1, and ß2 bands (4-30 Hz) consistently included frontal sites when the eyes were closed, whereas the small-scale network for γ band (31-55 Hz) consistently clustered in medial-central-posterior sites whether the eyes were open or closed. Large-scale activations and suppressions involving over 17-30% (10-18 of 60) of EEG sites were also prolonged and generally clustered in regions complementary to where small-scale activations and suppressions clustered. In contrast, intermediate-scale activations and suppressions (involving 7-17% of EEG sites) tended to follow stochastic dynamics and were less consistently localized. These results suggest that strong synchronizations and desynchronizations tend to occur in small-scale and large-scale networks that are spatially segregated and frequency specific. These synchronization networks may broadly segregate the relatively independent and highly cooperative oscillatory processes while phase realignments fine-tune the network configurations based on behavioral demands.

Probabilistic, entropy-maximizing control of large-scale neural synchronization.

Oscillatory neural activity is dynamically controlled to coordinate perceptual, attentional and cognitive processes. On the macroscopic scale, this control is reflected in the U-shaped deviations of EEG spectral-power dynamics from stochastic dynamics, characterized by disproportionately elevated occurrences of the lowest and highest ranges of power. To understand the mechanisms that generate these low- and high-power states, we fit a simple mathematical model of synchronization of oscillatory activity to human EEG data. The results consistently indicated that the majority (~95%) of synchronization dynamics is controlled by slowly adjusting the probability of synchronization while maintaining maximum entropy within the timescale of a few seconds. This strategy appears to be universal as the results generalized across oscillation frequencies, EEG current sources, and participants (N = 52) whether they rested with their eyes closed, rested with their eyes open in a darkened room, or viewed a silent nature video. Given that precisely coordinated behavior requires tightly controlled oscillatory dynamics, the current results suggest that the large-scale spatial synchronization of oscillatory activity is controlled by the relatively slow, entropy-maximizing adjustments of synchronization probability (demonstrated here) in combination with temporally precise phase adjustments (e.g., phase resetting generated by sensorimotor interactions). Interestingly, we observed a modest but consistent spatial pattern of deviations from the maximum-entropy rule, potentially suggesting that the mid-central-posterior region serves as an "entropy dump" to facilitate the temporally precise control of spectral-power dynamics in the surrounding regions.

EEG state-trajectory instability and speed reveal global rules of intrinsic spatiotemporal neural dynamics.

Spatiotemporal dynamics of EEG/MEG (electro-/magneto-encephalogram) have typically been investigated by applying time-frequency decomposition and examining amplitude-amplitude, phase-phase, or phase-amplitude associations between combinations of frequency bands and scalp sites, primarily to identify neural correlates of behaviors and traits. Instead, we directly extracted global EEG spatiotemporal dynamics as trajectories of k-dimensional state vectors (k = the number of estimated current sources) to investigate potential global rules governing neural dynamics. We chose timescale-dependent measures of trajectory instability (approximately the 2nd temporal derivative) and speed (approximately the 1st temporal derivative) as state variables, that succinctly characterized trajectory forms. We compared trajectories across posterior, central, anterior, and lateral scalp regions as the current sources under those regions may serve distinct functions. We recorded EEG while participants rested with their eyes closed (likely engaged in spontaneous thoughts) to investigate intrinsic neural dynamics. Some potential global rules emerged. Time-averaged trajectory instability from all five regions tightly converged (with their variability minimized) at the level of generating nearly unconstrained but slightly conservative turns (~100° on average) on the timescale of ~25 ms, suggesting that spectral-amplitude profiles are globally adjusted to maintain this convergence. Further, within-frequency and cross-frequency phase relations appear to be independently coordinated to reduce average trajectory speed and increase the variability in trajectory speed and instability in a relatively timescale-invariant manner, and to make trajectories less oscillatory. Future research may investigate the functional relevance of these intrinsic global-dynamics rules by examining how they adjust to various sensory environments and task demands or remain invariant. The current results also provide macroscopic constraints for quantitative modeling of neural dynamics as the timescale dependencies of trajectory instability and speed are relatable to oscillatory dynamics.

Vision perceptually restores auditory spectral dynamics in speech.

Visual speech facilitates auditory speech perception, but the visual cues responsible for these benefits and the information they provide remain unclear. Low-level models emphasize basic temporal cues provided by mouth movements, but these impoverished signals may not fully account for the richness of auditory information provided by visual speech. High-level models posit interactions among abstract categorical (i.e., phonemes/visemes) or amodal (e.g., articulatory) speech representations, but require lossy remapping of speech signals onto abstracted representations. Because visible articulators shape the spectral content of speech, we hypothesized that the perceptual system might exploit natural correlations between midlevel visual (oral deformations) and auditory speech features (frequency modulations) to extract detailed spectrotemporal information from visual speech without employing high-level abstractions. Consistent with this hypothesis, we found that the time-frequency dynamics of oral resonances (formants) could be predicted with unexpectedly high precision from the changing shape of the mouth during speech. When isolated from other speech cues, speech-based shape deformations improved perceptual sensitivity for corresponding frequency modulations, suggesting that listeners could exploit this cross-modal correspondence to facilitate perception. To test whether this type of correspondence could improve speech comprehension, we selectively degraded the spectral or temporal dimensions of auditory sentence spectrograms to assess how well visual speech facilitated comprehension under each degradation condition. Visual speech produced drastically larger enhancements during spectral degradation, suggesting a condition-specific facilitation effect driven by cross-modal recovery of auditory speech spectra. The perceptual system may therefore use audiovisual correlations rooted in oral acoustics to extract detailed spectrotemporal information from visual speech.

Rhythm Violation Enhances Auditory-Evoked Responses to the Extent of Overriding Sensory Adaptation in Passive Listening.

Sensory systems utilize temporal structure in the environment to build expectations about the timing of forthcoming events. We investigated the effects of rhythm-based temporal expectation on auditory responses measured with EEG recorded from the frontocentral sites implicated in auditory processing. By manipulating temporal expectation and the interonset interval (IOI) of tones, we examined how neural responses adapted to auditory rhythm and reacted to stimuli that violated the rhythm. Participants passively listened to the tones while watching a silent nature video. In Experiment 1 (n = 22), in the long-IOI block, tones were frequently presented (80%) with 1.7-sec IOI and infrequently presented (20%) with 1.2-sec IOI, generating unexpectedly early tones that violated temporal expectation. Conversely, in the short-IOI block, tones were frequently presented with 1.2-sec IOI and infrequently presented with 1.7-sec IOI, generating late tones. We analyzed the tone-evoked N1-P2 amplitude of ERPs and intertrial phase clustering in the theta-alpha band. The results provided evidence of strong delay-dependent adaptation effects (short-term, sensitive to IOI), weak cumulative adaptation effects (long-term, driven by tone repetition over time), and robust temporal-expectation violation effects over and above the adaptation effects. Experiment 2 (n = 22) repeated Experiment 1 with shorter IOIs of 1.2 and 0.7 sec. Overall, we found evidence of strong delay-dependent adaptation effects, weak cumulative adaptation effects (which may most efficiently accumulate at the tone presentation rate of ∼1 Hz), and robust temporal-expectation violation effects that substantially boost auditory responses to the extent of overriding the delay-dependent adaptation effects likely through mechanisms involved in exogenous attention.

Spectral-power associations reflect amplitude modulation and within-frequency interactions on the sub-second timescale and cross-frequency interactions on the seconds timescale.

We investigated the global structure of intrinsic cross-frequency dynamics by systematically examining power-based temporal associations among a broad range of oscillation frequencies both within and across EEG-based current sources (sites). We focused on power-based associations that could reveal unique timescale dependence independently of interacting frequencies. Large spectral-power fluctuations across all sites occurred at two characteristic timescales, sub-second and seconds, yielding distinct patterns of cross-frequency associations. On the fast sub-second timescale, within-site (local) associations were consistently between pairs of ß-γ frequencies differing by a constant Δf (particularly Δf ~ 10 Hz at posterior sites and Δf ~ 16 Hz at lateral sites) suggesting that higher-frequency oscillations are organized into Δf amplitude-modulated packets, whereas cross-site (long-distance) associations were all within-frequency (particularly in the >30 Hz and 6-12 Hz ranges, suggestive of feedforward and feedback interactions). On the slower seconds timescale, within-site (local) associations were characterized by a broad range of frequencies selectively associated with ~10 Hz at posterior sites and associations among higher (>20 Hz) frequencies at lateral sites, whereas cross-site (long-distance) associations were characterized by a broad range of frequencies at posterior sites selectively associated with ~10 Hz at other sites, associations among higher (>20 Hz) frequencies among lateral and anterior sites, and prevalent associations at ~10 Hz. Regardless of timescale, within-site (local) cross-frequency associations were weak at anterior sites indicative of frequency-specific operations. Overall, these results suggest that the fast sub-second-timescale coordination of spectral power is limited to local amplitude modulation and insulated within-frequency long-distance interactions (likely feedforward and feedback interactions), while characteristic patterns of cross-frequency interactions emerge on the slower seconds timescale. The results also suggest that the occipital α oscillations play a role in organizing higher-frequency oscillations into ~10 Hz amplitude-modulated packets to communicate with other regions. Functional implications of these timescale-dependent cross-frequency associations await future investigations.

Correction: Neural, functional, and aesthetic impacts of spatially heterogeneous flicker: A potential role of natural flicker.

[This corrects the article DOI: 10.1371/journal.pone.0219107.].

Exogenous Orientation of Attention to the Center of Mass in a Visual Search Task.

Anne Treisman's scientific career included broad-ranging contributions that advanced our understanding of the attentional mechanisms that people rely on to make sense of the world. In this paper, we describe results from a visual-search paradigm first developed by Grabowecky and Treisman (Grabowecky, 1992). Their design exploited known feature-search asymmetries (Treisman & Gormican, 1988) to investigate the role of a center of mass (CoM) mechanism in determining the initial locus of visual-spatial attention in visual search. The original experiment supported the hypothesis that CoM influences initial orienting of visual-spatial attention, as targets near the CoM of a multi-element array were detected more quickly than targets distant from the CoM. These findings were replicated in a follow-up experiment using a different feature-search asymmetry, with eye-tracking added to verify central fixation. We also investigated whether CoM had any influence on pop-out search, and found no evidence that it does. Surprisingly, the effect of position of the search array on the CoM suggested that CoM may be computed independently for elements contained within each visual hemifield. Whereas our work on CoM with Treisman was initiated within an earlier theoretical context, the present results are also compatible with contemporary theoretical advances; both the early results and the new results can be integrated within current ways of thinking about attention and pre-attentive mechanisms.

Neural, functional, and aesthetic impacts of spatially heterogeneous flicker: A potential role of natural flicker.

Spatially heterogeneous flicker, characterized by probabilistic and locally independent luminance modulations, abounds in nature. It is generated by flames, water surfaces, rustling leaves, and so on, and it is pleasant to the senses. It affords spatiotemporal multistability that allows sensory activation conforming to the biases of the visual system, thereby generating the perception of spontaneous motion and likely facilitating the calibration of motion detectors. One may thus hypothesize that spatially heterogeneous flicker might potentially provide restoring stimuli to the visual system that engage fluent (requiring minimal top-down control) and self-calibrating processes. Here, we present some converging behavioral and electrophysiological evidence consistent with this idea. Spatially heterogeneous (multistable) flicker (relative to controls matched in temporal statistics) reduced posterior EEG (electroencephalography) beta power implicated in long-range neural interactions that impose top-down influences on sensory processing. Further, the degree of spatiotemporal multistability, the amount of posterior beta-power reduction, and the aesthetic responses to flicker were closely associated. These results are consistent with the idea that the pleasantness of natural flicker may derive from its spatiotemporal multistability that affords fluent and self-calibrating visual processing.

Probability-driven and stimulus-driven orienting of attention to time and sensory modality.

The timing and the sensory modality of behaviorally relevant events often vary predictably, so that it is beneficial to adapt the sensory system to their statistical regularities. Indeed, statistical information about target timing and/or sensory modality modulates behavioral responses-called expectation effects. Responses are also facilitated by short-term repetitions of target timing and/or sensory modality-called priming effects. We examined how the expectation and priming effects on target timing (short vs. long cue-to-target interval) and target modality (auditory vs. visual) interacted. Temporal expectation was manipulated across blocks, while modality expectation was manipulated across participants. Responses were faster when targets were presented at the expected timing and/or in the expected modality in an additive manner, suggesting that temporal and modality expectation operate relatively independently. Similarly, responses were faster when the timing and/or modality of targets was repeated across trials in an additive manner, suggesting that temporal and modality priming operate relatively independently. Importantly, the interactions between expectation and priming were domain specific. In the temporal domain, temporal-expectation effects were observed only when temporal-priming effects were absent. In the modality domain, modality-priming effects predominated for auditory targets whereas modality-expectation effects predominated for visual targets. Thus, the interactions between probability-driven expectation and stimulus-driven priming processes appear to be controlled separately for the mechanisms that direct attention to specific temporal intervals and for the mechanisms that direct attention to specific sensory modalities. These results may suggest that the sensory system concurrently optimizes attentional priorities within temporal and sensory-modality domains.

Monitoring prediction errors facilitates cognition in action.

Cognition in action requires strategic allocation of attention between internal processes and the sensory environment. We hypothesized that this resource allocation could be facilitated by mechanisms that predict sensory results of self-generated actions. Sensory signals conforming to predictions would be safely ignored to facilitate focus on internally generated content, whereas those violating predictions would draw attention for additional scrutiny. During a visual-verbal serial digit-recall task, we varied the temporal relationship between task-irrelevant keypresses and auditory distractors so that the distractors were either temporally coupled or decoupled with keypresses. Consistent with our hypothesis, distractors were more likely to interfere with target maintenance and intrude into working memory when they were decoupled from keypresses, thereby violating action-based sensory predictions. Interference was maximal when sounds preceded keypresses, suggesting that stimuli were most distracting when their timing was inconsistent with expected action-sensation contingencies. In a follow-up experiment, neither auditory nor visual cues to distractor timing produced similar effects, suggesting a unique action-based mechanism. These results suggest that action-based sensory predictions are used to dynamically optimize attentional allocation during cognition in action. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Near complete interocular transfer of the attentional repulsion effect.

During a brief period following attention capture by an abrupt-onset cue, a briefly presented item in the vicinity appears to be displaced away from the focus of attention. This effect, termed the attentional repulsion effect (ARE), can be induced with various ways of focusing attention (e.g., color pop-out, an auditory cue, voluntary focusing), and can be measured in various ways (e.g., as a vernier offset, shape deformation, action error). While most prior results on ARE have confirmed its close relationship with attention mechanisms, DiGiacomo and Pratt Vision Research 64 (2012) 35-41 reported no interocular transfer of ARE, placing ARE's operational locus at the level of monocular processing in V1 and/or LGN. DiGiacomo's and Pratt's result is surprising because even local pattern adaptation effects thought to be mediated by V1 show 50%-80% of interocular transfer. How could it be that a strongly attention-dependent effect is exclusively mediated by monocular processes? It was thus important to replicate DiGiacomo's and Pratt's surprising results using a transient-free mirror-based stereoscope and a broader method where ARE was measured with both vertical and horizontal vernier offsets. Our results demonstrate a nearly complete interocular transfer of ARE, with stronger ARE obtained with horizontal than with vertical verniers, implying that ARE may be hemifield dependent. We speculate that the null ARE result reported by DiGiacomo and Pratt in their dichoptic condition may be due to a statistical anomaly or to a potential visual artifact generated by the eye shutters that were used to present dichoptic stimuli.

Automatic auditory disambiguation of visual awareness.

Multisensory integration can play a critical role in producing unified and reliable perceptual experience. When sensory information in one modality is degraded or ambiguous, information from other senses can crossmodally resolve perceptual ambiguities. Prior research suggests that auditory information can disambiguate the contents of visual awareness by facilitating perception of intermodally consistent stimuli. However, it is unclear whether these effects are truly due to crossmodal facilitation or are mediated by voluntary selective attention to audiovisually congruent stimuli. Here, we demonstrate that sounds can bias competition in binocular rivalry toward audiovisually congruent percepts, even when participants have no recognition of the congruency. When speech sounds were presented in synchrony with speech-like deformations of rivalling ellipses, ellipses with crossmodally congruent deformations were perceptually dominant over those with incongruent deformations. This effect was observed in participants who could not identify the crossmodal congruency in an open-ended interview (Experiment 1) or detect it in a simple 2AFC task (Experiment 2), suggesting that the effect was not due to voluntary selective attention or response bias. These results suggest that sound can automatically disambiguate the contents of visual awareness by facilitating perception of audiovisually congruent stimuli.

An Association between Auditory-Visual Synchrony Processing and Reading Comprehension: Behavioral and Electrophysiological Evidence.

The perceptual system integrates synchronized auditory-visual signals in part to promote individuation of objects in cluttered environments. The processing of auditory-visual synchrony may more generally contribute to cognition by synchronizing internally generated multimodal signals. Reading is a prime example because the ability to synchronize internal phonological and/or lexical processing with visual orthographic processing may facilitate encoding of words and meanings. Consistent with this possibility, developmental and clinical research has suggested a link between reading performance and the ability to compare visual spatial/temporal patterns with auditory temporal patterns. Here, we provide converging behavioral and electrophysiological evidence suggesting that greater behavioral ability to judge auditory-visual synchrony (Experiment 1) and greater sensitivity of an electrophysiological marker of auditory-visual synchrony processing (Experiment 2) both predict superior reading comprehension performance, accounting for 16% and 25% of the variance, respectively. These results support the idea that the mechanisms that detect auditory-visual synchrony contribute to reading comprehension.

Temporal expectation weights visual signals over auditory signals.

Temporal expectation is a process by which people use temporally structured sensory information to explicitly or implicitly predict the onset and/or the duration of future events. Because timing plays a critical role in crossmodal interactions, we investigated how temporal expectation influenced auditory-visual interaction, using an auditory-visual crossmodal congruity effect as a measure of crossmodal interaction. For auditory identification, an incongruent visual stimulus produced stronger interference when the crossmodal stimulus was presented with an expected rather than an unexpected timing. In contrast, for visual identification, an incongruent auditory stimulus produced weaker interference when the crossmodal stimulus was presented with an expected rather than an unexpected timing. The fact that temporal expectation made visual distractors more potent and visual targets less susceptible to auditory interference suggests that temporal expectation increases the perceptual weight of visual signals.

Comparing the effects of implicit and explicit temporal expectation on choice response time and response conflict.

People can use temporally structured sensory information to anticipate future events. Temporal information can be presented implicitly through probability manipulation without participants' awareness of the manipulation, or explicitly conveyed through instructions. We examined how implicit and explicit temporal information established temporal expectations that influenced choice response times and response conflict (measured as flanker effects). We implicitly manipulated temporal structure by block-wise varying the likely timing of a target. In the short-interval block, a target was presented frequently (80 % of trials) after a short (400 ms) cue-to-target interval and infrequently (20 % of trials) after a long (1200 ms) interval; the probability assignment was reversed in the long-interval block. Building on this baseline condition (Experiment 1), we augmented the temporal information by filling the cue-to-target intervals with tones (Experiment 2), explicitly informed participants of the prevalent time interval (Experiment 3) and provided trial-by-trial reminders of the prevalent time interval (Experiment 4). The temporal probability manipulation alone (of which participants were unaware) influenced choice response times but only when the temporal information was augmented with tones, whereas providing the explicit knowledge of the temporal manipulation, with or without trial-by-trial reminders, robustly influenced choice response times. Response conflict was unaffected by these conditions. These results suggest that temporal expectation can be established by the implicit learning of a temporal structure given that sufficiently strong temporal information is presented as well as by the explicit knowledge of the temporal structure. This established temporal expectation influences choice response times without necessarily affecting the strength of response conflict.

Sleeping on the rubber-hand illusion: Memory reactivation during sleep facilitates multisensory recalibration.

Plasticity is essential in body perception so that physical changes in the body can be accommodated and assimilated. Multisensory integration of visual, auditory, tactile, and proprioceptive signals contributes both to conscious perception of the body's current state and to associated learning. However, much is unknown about how novel information is assimilated into body perception networks in the brain. Sleep-based consolidation can facilitate various types of learning via the reactivation of networks involved in prior encoding or through synaptic down-scaling. Sleep may likewise contribute to perceptual learning of bodily information by providing an optimal time for multisensory recalibration. Here we used methods for targeted memory reactivation (TMR) during slow-wave sleep to examine the influence of sleep-based reactivation of experimentally induced alterations in body perception. The rubber-hand illusion was induced with concomitant auditory stimulation in 24 healthy participants on 3 consecutive days. While each participant was sleeping in his or her own bed during intervening nights, electrophysiological detection of slow-wave sleep prompted covert stimulation with either the sound heard during illusion induction, a counterbalanced novel sound, or neither. TMR systematically enhanced feelings of bodily ownership after subsequent inductions of the rubber-hand illusion. TMR also enhanced spatial recalibration of perceived hand location in the direction of the rubber hand. This evidence for a sleep-based facilitation of a body-perception illusion demonstrates that the spatial recalibration of multisensory signals can be altered overnight to stabilize new learning of bodily representations. Sleep-based memory processing may thus constitute a fundamental component of body-image plasticity.